Combining Statistical Tests by Multiplying P-values
نویسنده
چکیده
A general discussion on combining statistical hypothesis tests is followed by an application involving point source detection in skymaps. The traditional literature on combining statistical tests has concentrated on a regime in which p-values as large as 0.05 are still of interest, and in which it is dangerous to treat tests as truly independent. But for point source detection, very small p-values are desired, and situations can arise in which one can fairly assume independence of the tests.
منابع مشابه
Combining Information from Independent Sources through Confidence Distributions
This paper develops new methodology, together with related theories, for combining information from independent studies through confidence distributions. A formal definition of a confidence distribution and its asymptotic counterpart (i.e., asymptotic confidence distribution) are given and illustrated in the context of combining information. Two general combination methods are developed: the fi...
متن کاملAccuracy Evaluation of the Unified P-Value from Combining Correlated P-Values
Meta-analysis methods that combine P-values into a single unified P-value are frequently employed to improve confidence in hypothesis testing. An assumption made by most meta-analysis methods is that the P-values to be combined are independent, which may not always be true. To investigate the accuracy of the unified P-value from combining correlated P-values, we have evaluated a family of stati...
متن کاملComputing Critical Values of Exact Tests by Incorporating Monte Carlo Simulations Combined with Statistical Tables.
Various exact tests for statistical inference are available for powerful and accurate decision rules provided that corresponding critical values are tabulated or evaluated via Monte Carlo methods. This article introduces a novel hybrid method for computing p-values of exact tests by combining Monte Carlo simulations and statistical tables generated a priori. To use the data from Monte Carlo gen...
متن کاملHolm ’ s Sequential Bonferroni Procedure
The more statistical tests we perform, the more likely we are to reject the null hypothesis when it is true (i.e., a “false alarm,” also called a “Type 1” error). This is a consequence of the logic of hypothesis testing: We reject the null hypothesis for rare events, and the larger the number of tests, the easier it is to find rare events which are false alarms. This problem is called the infla...
متن کاملA modified generalized Fisher method for combining probabilities from dependent tests
Rapid developments in molecular technology have yielded a large amount of high throughput genetic data to understand the mechanism for complex traits. The increase of genetic variants requires hundreds and thousands of statistical tests to be performed simultaneously in analysis, which poses a challenge to control the overall Type I error rate. Combining p-values from multiple hypothesis testin...
متن کامل